FEW SHOT PHOTOGRAMETRY: A COMPARISON BETWEEN NERF AND MVS-SFM FOR THE DOCUMENTATION OF CULTURAL HERITAGE

3D documentation methods for Digital Cultural Heritage (DCH) domain is a field that becomes increasingly interdisciplinary, breaking down boundaries that have long separated experts from different domains. In the past, there has been an ambiguous claim for ownership of skills, methodologies, and expertise in the heritage sciences. This study aims to contribute to the dialogue between these different disciplines by presenting a novel approach for 3D documentation of an ancient statue. The method combines TLS acquisition and MVS pipeline using images from a DJI Mavic 2 drone. Additionally, the study compares the accuracy and final product of the Deep Points (DP) and Neural Radiance Fields (NeRF) methods, using the TLS acquisition as validation ground truth. Firstly, a TLS acquisition was performed on an ancient statue using a Faro Focus 2 scanner. Next, a multi-view stereo (MVS) pipeline was adopted using 2D images captured by a Mini-2 DJI Mavic 2 drone from a distance of approximately 1 meter around the statue. Finally, the same images were used to train and run the NeRF network after being reduced by 90%. The main contribution of this paper is to improve our understanding of this method and compare the accuracy and final product of two different approaches - direct projection (DP) and NeRF - by exploiting a TLS acquisition as the validation ground truth. Results show that the NeRF approach outperforms DP in terms of accuracy and produces a more realistic final product. This paper has important implications for the field of CH preservation, as it offers a new and effective method for generating 3D models of ancient statues. This technology can help to document and preserve important cultural artifacts for future generations, while also providing new insights into the history and culture of different civilizations. Overall, the results of this study demonstrate the potential of combining TLS and NeRF for generating accurate and realistic 3D models of ancient statues

Learning-based screening of endothelial dysfunction from photoplethysmographic signals

Endothelial-Dysfunction (ED) screening is of primary importance to early diagnosis cardiovascular diseases. Recently, approaches to ED screening are focusing more and more on photoplethysmography (PPG)-signal analysis, which is performed in a threshold-sensitive way and may not be suitable for tackling the high variability of PPG signals. The goal of this work was to present an innovative machine-learning (ML) approach to ED screening that could tackle such variability. Two research hypotheses guided this work: (H1) ML can support ED screening by classifying PPG features; and (H2) classification performance can be improved when including also anthropometric features. To investigate H1 and H2, a new dataset was built from 59 subject. The dataset is balanced in terms of subjects with and without ED. Support vector machine (SVM), random forest (RF) and k-nearest neighbors (KNN) classifiers were investigated for feature classification. With the leave-one-out evaluation protocol, the best classification results for H1 were obtained with SVM (accuracy = 71%, recall = 59%). When testing H2, the recall was further improved to 67%. Such results are a promising step for developing a novel and intelligent PPG device to assist clinicians in performing large scale and low cost ED screening

Identifying the use of a park based on clusters of visitors' movements from mobile phone data

none6noPlanning urban parks is a burdensome task, requiring knowledge of countless variables that are impossible to consider all at the same time. One of these variables is the set of people who use the parks. Despite information and communication technologies being a valuable source of data, a standardized method which enables landscape planners to use such information to design urban parks is still broadly missing. The objective of this study is to design an approach that can identify how an urban green park is used by its visitors in order to provide planners and the managing authorities with a standardized method. The investigation was conducted by exploiting tracking data from an existing mobile application developed for Cardeto Park, an urban green area in the heart of the old town of Ancona, Italy. A trajectory clustering algorithm is used to infer the most common trajectories of visitors, exploiting global positioning system and sensor-based tracks. The data used are made publicly available in an open dataset, which is the first one based on real data in this field. On the basis of these user-generated data, the proposed datadriven approach can determine the mission of the park by processing visitors' trajectories whilst using a mobile application specifically designed for this purpose. The reliability of the clustering method has also been confirmed by an additional statistical analysis. This investigation reveals other important user behavioral patterns or trends.openPierdicca R.; Paolanti M.; Vaira R.; Marcheggiani E.; Malinverni E.S.; Frontoni E.Pierdicca, R.; Paolanti, M.; Vaira, R.; Marcheggiani, E.; Malinverni, E. S.; Frontoni, E

DEEP CONVOLUTIONAL NEURAL NETWORKS FOR SENTIMENT ANALYSIS OF CULTURAL HERITAGE

Abstract. The promotion of Cultural Heritage (CH) goods has become a major challenges over the last years. CH goods promote economic development, notably through cultural and creative industries and tourism. Thus, an effective planning of archaeological, cultural, artistic and architectural sites within the territory make CH goods easily accessible. A way of adding value to these services is making them capable of providing, using new technologies, a more immersive and stimulating fruition of information. In this light, an effective contribution can be provided by sentiment analysis. The sentiment related to a monument can be used for its evaluation considering that if it is positive, it influences its public image by increasing its value. This work introduces an approach to estimate the sentiment of Social Media pictures CH related. The sentiment of a picture is identified by an especially trained Deep Convolutional Neural Network (DCNN); aftewards, we compared the performance of three DCNNs: VGG16, ResNet and InceptionResNet. It is interesting to observe how these three different architectures are able to correctly evaluate the sentiment of an image referred to a ancient monument, historical buildings, archaeological sites, museum objects, and more. Our approach has been applied to a newly collected dataset of pictures from Instagram, which shows CH goods included in the UNESCO list of World Heritage properties.</p

Sharing health data among general practitioners: The Nu.Sa. project

Today, e-health has entered the everyday work flow in the form of a variety of healthcare providers. General practitioners (GPs) are the largest category in the public sanitary service, with about 60,000 GPs throughout Italy. Here, we present the Nu.Sa. project, operating in Italy, which has established one of the first GP healthcare information systems based on heterogeneous data sources. This system connects all providers and provides full access to clinical and health-related data. This goal is achieved through a novel technological infrastructure for data sharing based on interoperability specifications recognised at the national level for messages transmitted from GP providers to the central domain. All data standards are publicly available and subjected to continuous improvement. Currently, the system manages more than 5,000 GPs with about 5,500,000 patients in total, with 4,700,000 pharmacological e-prescriptions and 1,700,000 e-prescriptions for laboratory exams per month. Hence, the Nu.Sa. healthcare system that has the capacity to gather standardised data from 16 different form of GP software, connecting patients, GPs, healthcare organisations, and healthcare professionals across a large and heterogeneous territory through the implementation of data standards with a strong focus on cybersecurity. Results show that the application of this scenario at a national level, with novel metrics on the architecture's scalability and the software's usability, affect the sanitary system and on GPs’ professional activities

A BENCHMARK FOR LARGE-SCALE HERITAGE POINT CLOUD SEMANTIC SEGMENTATION

The lack of benchmarking data for the semantic segmentation of digital heritage scenarios is hampering the development of automatic classification solutions in this field. Heritage 3D data feature complex structures and uncommon classes that prevent the simple deployment of available methods developed in other fields and for other types of data. The semantic classification of heritage 3D data would support the community in better understanding and analysing digital twins, facilitate restoration and conservation work, etc. In this paper, we present the first benchmark with millions of manually labelled 3D points belonging to heritage scenarios, realised to facilitate the development, training, testing and evaluation of machine and deep learning methods and algorithms in the heritage field. The proposed benchmark, available at http://archdataset.polito.it/, comprises datasets and classification results for better comparisons and insights into the strengths and weaknesses of different machine and deep learning approaches for heritage point cloud semantic segmentation, in addition to promoting a form of crowdsourcing to enrich the already annotated databas

ARTIFICIAL INTELLIGENCE AND CULTURAL HERITAGE: DESIGN AND ASSESSMENT OF AN ETHICAL FRAMEWORK

The pioneering use of Artificial Intelligence (AI) in various fields and sectors, and the growing ethical debate about its application have led research centers, public and private institutions to establish ethical guidelines for a trustworthy implementation of these powerful algorithms. Despite the recognized definition of ethical principles for a responsible or trustworthy use of AI, there is a lack of a sector-specific perspective that highlights the ethical risks and opportunities for different areas of application, especially in the field of Cultural Heritage (CH). In fact, there is still a lack of formal frameworks that evaluate the algorithms’ adherence to the ethical standards set by the European Union for the use of AI in protecting CH and its inherent value. Because of this, it is necessary to investigate a different sectoral viewpoint to supplement the widely used horizontal approach. This paper represents a first attempt to design an ethical framework to embody AI in CH conservation practises to assess various risks arising from the use of AI in the field of CH. The contribution presents a synthesis of the different AI applications to improve the preservation process of CH. It explores and analyses in depth the ethical challenges and opportunities presented by the use of AI to improve CH preservation. In addition, the study aims to design an ethical framework of principles to assess the application of this ground-breaking technology at CH

Open-world person re-identification with RGBD camera in top-view configuration for retail applications

Person re-identification (re-ID) is currently a notably topic in the computer vision and pattern recognition communities. However, most of the existing works on re-ID have been designed for closed world scenarios, rather than more realistic open world scenarios, limiting the practical application of these re-ID techniques. In a common real-world application, a watch-list of known people is given as the gallery/target set for searching through a large volume of videos where the people on the watch-list are likely to return. This aspect is fundamental in retail for understanding how customers schedule their shopping. The identification of regular and occasional customers allows to define temporal purchasing profiles, which can put in correlation the customers' temporal habits with other information such as the amount of expenditure and number of purchased items. This paper presents the first attempt to solve a more realistic re-ID setting, designed to face these important issues called Top-View Open-World (TVOW) person re-id. The approach is based on a pretrained Deep Convolutional neural Network (DCNN), finetuned on a dataset acquired by using a top-view configuration. A special loss function called triplet loss was used to train the network. The triplet loss optimizes the embedding space such that data points with the same identity are closer to each other than those with different identities. The TVOW is evaluated on the TVPR2 dataset for people re-ID that is publicly available. The experimental results show that the proposed methods significantly outperform all competitive state-of-the-art methods, bringing to different and significative insights for implicit and extensive shopper behaviour analysis for marketing applications

GeoAI: a review of artificial intelligence approaches for the interpretation of complex geomatics data

Researchers have explored the benefits and applications of modern artificial intelligence (AI) algorithms in different scenarios. For the processing of geomatics data, AI offers overwhelming opportunities. Fundamental questions include how AI can be specifically applied to or must be specifically created for geomatics data. This change is also having a significant impact on geospatial data. The integration of AI approaches in geomatics has developed into the concept of geospatial artificial intelligence (GeoAI), which is a new paradigm for geographic knowledge discovery and beyond. However, little systematic work currently exists on how researchers have applied AI for geospatial domains. Hence, this contribution outlines AI-based techniques for analysing and interpreting complex geomatics data. Our analysis has covered several gaps, for instance defining relationships between AI-based approaches and geomatics data. First, technologies and tools used for data acquisition are outlined, with a particular focus on red-green-blue (RGB) images, thermal images, 3D point clouds, trajectories, and hyperspectral-multispectral images. Then, how AI approaches have been exploited for the interpretation of geomatic data is explained. Finally, a broad set of examples of applications is given, together with the specific method applied. Limitations point towards unexplored areas for future investigations, serving as useful guidelines for future research directions